Visuo-haptic object perception for robots: an overview
نویسندگان
چکیده
The object perception capabilities of humans are impressive, and this becomes even more evident when trying to develop solutions with a similar proficiency in autonomous robots. While there have been notable advancements the technologies for artificial vision touch, effective integration these two sensory modalities robotic applications still needs be improved, several open challenges exist. Taking inspiration from how combine visual haptic perceive properties drive execution manual tasks, article summarises current state art visuo-haptic Firstly, biological basis human multimodal is outlined. Then, latest advances sensing data collection strategies robots discussed. Next, an overview main computational techniques presented, highlighting machine learning presenting few representative articles areas recognition, peripersonal space representation manipulation. Finally, informed by challenges, outlines promising new research directions.
منابع مشابه
Probabilistic Classification of Grasping Behaviours Using Visuo-Haptic Perception
This paper presents a novel approach to visuo-haptic perception of grasping/manipulative tasks. The proposed approach is founded on a hierarchical Bayesian model which integrates the visual information with the haptic data to reach a reasonable percept of what is happening in grasping tasks. The primary goal of the approach is to identify what type of grasping behaviour is being performed by th...
متن کاملVisuo-haptic multisensory object recognition, categorization, and representation
Visual and haptic unisensory object processing show many similarities in terms of categorization, recognition, and representation. In this review, we discuss how these similarities contribute to multisensory object processing. In particular, we show that similar unisensory visual and haptic representations lead to a shared multisensory representation underlying both cross-modal object recogniti...
متن کاملShort-term plasticity of visuo-haptic object recognition
Functional magnetic resonance imaging (fMRI) studies have provided ample evidence for the involvement of the lateral occipital cortex (LO), fusiform gyrus (FG), and intraparietal sulcus (IPS) in visuo-haptic object integration. Here we applied 30 min of sham (non-effective) or real offline 1 Hz repetitive transcranial magnetic stimulation (rTMS) to perturb neural processing in left LO immediate...
متن کاملHaptic Exploration for Navigation Tasks using a Visuo-Haptic Sensor
A system is presented for the haptic exploration of objects in a household environment. Haptic properties are acquired using a passive, deformable sensor tip mounted on a platform. The sensor deformation is measured visually, allowing for a flexible and low-cost design. Navigation of simple robots, such as vacuum cleaners, is improved by active manipulation. Simple service robots for households...
متن کاملCorrecting for Visuo-Haptic Biases in 3D Haptic Guidance
Visuo-haptic biases are observed when bringing your unseen hand to a visual target. The biases are different between, but consistent within participants. We investigated the usefulness of adjusting haptic guidance to these user-specific biases in aligning haptic and visual perception. By adjusting haptic guidance according to the biases, we aimed to reduce the conflict between the modalities. W...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Autonomous Robots
سال: 2023
ISSN: ['0929-5593', '1573-7527']
DOI: https://doi.org/10.1007/s10514-023-10091-y